1. Beat Analysis for Game Visualization 
2. Frequency Analysis for Piece Selection 


Beat Analysis for Game Visualization 


One of the algorithms we chose to implement was a beat detections 
algorithm. In the game this maps to a pulsing visualization. 


Background 


When a drum is hit, a spike in energy occurs across all frequencies. When a 
bass guitar is plucked, there is a spike in energy in the lower frequires. As 
these two instruments are commonly used in modern music to give a song 
rhythm or a beat, we decided to look at energy in the lower end of the 
spectrum. Theoretically, this should automatically filter out other spikes of 
energy created by a vocalist or electric guitar. 

Beat Detection on Metric's "Gimme Sympathy" 
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Beat Detection on Flogging Molly's "Don't Shut 'Em Down" 
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Using Energy Comparisons to Detect Beats 


Energy Calculation 

Because energy spikes when a beat occurs, it is fairly straight forward to 
implement an algorithm which compares an average local energy to an 
instantaneous energy. Because we only want to look at the low frequencies, 
we need to compute the FFT of the signal. Then, we compute the average 
local energy by taking the integral of the square of the FFT of a second in 


time over the number of samples. The instantaneous energy is calculated by 
taking the integral of the square of the FFT of a single sample. 
Equation: 


Equation: 


Constant Calculation 

Probabilistically speaking, if the instantaneous energy is greater than the 
local energy by a large enough quantity, we can say with a high likelihood 
that a beat has occured. The quantity is realized through the variance of the 
instantaneous energy to the average local energy. A constant is then 
calculated from the variance and we can see that the instantaneous energy 
needs to be a factor of the constant larger than the average local energy. 
Equation: 
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Filtering Extra Beats 


If a beat is detected, its sample number is recorded in a vector. If a beat 
spikes for multiple samples, multiple beats would be recorded which leads 
to an overestimation of the current tempo. To account for this, we merely 
look at the samples, detect a leading edge where the first beat is recorded, 
and ignore all subsequent sequential beats. 


Frequency Analysis for Piece Selection 


Interval Generation for Ten Second Sections 


Energy Computation 

First, for a period of ten seconds the frequency spectrum is broken into bands of equal energy. The FFT of the 
signal is computed for the entire ten seconds and then bandlimited to the lower 10 KHz. The total energy across all 
frequencies is calculated. Because tetris has seven pieces, we will need seven frequency bands. By dividing the 
total energy by seven, we know have a target energy for each sections 

Equation: 


Equation: 


Interval Selection 

A binary search algorithm is implemented to find the bounds of each frequency band such that the energy of each 
section will equal the target energy within a reasonable error. Ideally, we could compute exactly equal energies but 
we are limited by the number of samples in our seconds interval. 

Equation: 


Each of these bands is then assigned a different game piece. 
Piece Selection Through Frequency Analysis 
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The spectrum is divided into seven equal energy sections for a ten second interval 


Piece Selection for Half Second Sections 


Once the frequency bands are computed for the section of the song, we compute the pieces. We take the FFT of a 
half-second samples and calculate the energy across each frequency band and find the maximum energy. The next 
piece is assigned accordingly. 

Equation: 


This process is repeated for each half second of the song. In theory, sections of the song with vocals will see more 
instances of the higher frequency pieces, while areas with bass guitar solos will be dominated by pieces from the 
lower frequencies. 


Amplitude Analysis for Drop Speed 


We performed an analysis on the volume of the song to determine how 
quickly the pieces in tetris should fall. The thinking behind this is that songs 
generally grow louder when they are growing more intense. Therefore, the 
game should become more intense when the song does. 


Envelope Generation 


We compute a constant based on the relative volume of the song such that 
the current drop speed can be determined as a fraction of the maximum fall 
speed. We determine the relative volume from the songs envelope. The 
envelope is computed by first taking the normalized magnitude of the signal 
and then setting each second of the song to the max value in that segment of 
the song. 

Equation: 
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Envelope from Raw Signal 
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The normalized envelope is generated from the raw signal by take max 
values from the absolute value of the signal 


Speed Calculation 


Because the signal is normalized, the value of the envelope at time t is 
equivalent to the fractional value of the maximum speed that the current 
speed is to be set at. 

Equation: 


